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Abstract: We investigate the transient times for the onset of control of steady states by time- 
delayed feedback. The optimization of control by minimising the transient time before control 
becomes effective is discussed analytically and numerically, and the competing influences of 
local and global features are elaborated. We derive an algebraic scaling of the transient time 
and confirm our findings by numerical simulations in dependence on feedback gain and time 
delay. 
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1. INTRODUCTION 

Control of nonlinear dynamical systems has attracted 
much attention since the seminal ground-breaking work of 
Ott, Grebogi, and Yorke (Ott et al., 1990), and a large vari- 
ety of different control schemes have been proposed (Frad- 
kov, 2007; Scholl and Schuster, 2008). One particularly 
successful method called time- delayed feedback control was 
introduced by Pyragas in order to stabilize periodic or- 
bits embedded in a strange attractor of a chaotic system 
(Pyragas, 1992). In this scheme, the difference between 
the current control signal s(t), which is generated from 
some system variables, and its time-delayed counterpart 
s(t—r) yields a control force that is fed back to the system. 
If the time delay matches the period of the target orbit, 
this control force vanishes. Thus, time-delayed feedback 
is a noninvasive control method. The Pyragas scheme has 
been successfully applied for the control of both unstable 
steady states (Hovel and Scholl, 2005; Dahms et al., 2007) 
and periodic orbits in different areas of research ranging 
from mechanical (Blyuss et al., 2008; Sieber et al., 2008) 
and neurobiological systems (Scholl et al., 2009; Schneider 
et al., 2009) to optics (Tronciu et al., 2006; Schikora et al., 
2006; Flunkert and Scholl, 2007; Dahms et al., 2008) as 
well as semiconductor devices (Scholl, 2001, 2009) and 
chemical systems (Balanov et al., 2006). On the theoretical 
part, previous work includes investigations on analytical 
properties (Just et al., 2004; Amann et al., 2007), asymp- 
totic scaling for large time delays (Yanchuk et al., 2006; 
Yanchuk and Perlikowski, 2009), and limitations of this 
powerful control method (Fiedler et al., 2007; Just et al., 

2007) . However, the transient dynamics of time-delayed 
feedback control has not been investigated systematically. 

In this paper, we aim to obtain a deeper insight into the 
control mechanism and its efficiency by an analysis of 
transient times before control is achieved. The transient 
times and their scaling behavior have been studied in 
particular in the context of chaotic transients (Tel and Lai, 

2008) , e.g., in spatially extended systems, where super- 
transients were found. Here, we consider the case of steady 
states in linear and nonlinear systems which are subject 



to time-delayed feedback control. We investigate a generic 
system beyond a supercritical Hopf bifurcation. Thus, the 
unstable fixed point can be treated as a linearized normal 
form above the bifurcation. Furtheron, we focus also on 
global aspects (von Loewenich et al., 2004; Hohne et al., 
2007). 

This paper is organized as follows: In Sec. 2, we investigate 
the transient times of control of an unstable focus in the 
presence of time-delayed feedback within a linear model 
and relate this quantity to the eigenvalues of the controlled 
system. Section 3 is devoted to effects of time-delayed 
feedback on transient times of fixed point control in a 
nonlinear system under the influence of stable periodic 
orbits. We finish with a conclusion in Sec. 4. 

2. LINEAR TRANSIENTS 

In this Section, we consider an unstable fixed point of focus 
type which is subject to time-delayed feedback (Hovel and 
Scholl, 2005; Dahms et al., 2007). It can be described 
within a generic model in center-manifold coordinates by 
a linear system which corresponds to the normal form 
close to, but above a supercritical Hopf bifurcation whose 
nonlinear effects will be discussed in Sec. 3. The dynamic 
equations are given by 



x(t) = Xx(t) + uy(t) - K [x(t) - x(t - 
y(t) = -ux(t) + Xy(t) - K [y(t) - y(t 



r)] 

-r)], 



(la) 
(lb) 



where A > corresponds to the regime of unstable fixed 
point and uj ^ is the intrinsic frequency of the focus. 
The control parameters K £ R and r £ R denote the 
feedback gain and time delay, respectively. In complex 
notation z = x ±iy, Eqs. (1) become 

z{t) = (A ± iuj)z{t) - K [z(t) - z(t - t)} . (2) 

Similarly, using z = re llf with amplitude r > and 
phase (/?, Eq. (2) can be rewritten in the uncontrolled case 
(K = 0) as 
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Fig. 1. (a): Largest real part of the complex eigenvalues 
A vs K for a fixed time delay r = To/2 = 1 
(solid curve). The dashed red curves show additional 
modes, (b): Transient time r tr in dependence on the 
feedback gain K. The solid curve corresponds to the 
analytical formula (7) and the green dots refer to 
values obtained by numerical simulations of Eqs. (1). 
The green lines at KT = AT /2 = 0.1 and KT = 
94.76 correspond to the flip (Kfi) and Hopf threshold 
(Kho), respectively. Parameters: A = 0.1, uo = 7r, 
r = T /2 = 1, r = 0.1, and e = 0.001. 

r(t) = \r(t), <p(t)=u. (3) 

The amplitude equation will serve as starting point of our 
analytical derivations presented later in this Section. 

The stability of the system (1) can be inferred from the 
characteristic equation 

[A + K(l-e- AT )-\] 2 +co 2 = 0, (4) 

where the fixed point is stable if the real part of all 
eigenvalues A G C is negative. Note that solutions of this 
transcendental equation can be found analytically using 
the multi-valued Lambert function W which is defined as 
the inverse function of f(z) = ze z for z G C (Hovel and 
Scholl, 2005): 

A = \ W (Vre- (A±ia;)r+Kr ) + A ± iu - K. (5) 

In the following the initial conditions are taken from the 
uncontrolled system for t G [— r, 0) and the control is 
switched on at t = 0. Figure 1(a) depicts the largest real 
parts of the eigenvalues A calculated from the character- 
istic equation (4) in dependence on the feedback gain K. 
The time delay is fixed at r = Tq/2 = 1 with the intrinsic 
timescale To = 2it/uj. The dashed red curves refer to lower 
eigenvalues arising from — oo in the limit of vanishing K. In 
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Fig. 2. Transient times for the unstable focus in the (K, r) 
plane as color code. The black curves show the bound- 
ary of the domain of control, i.e., ReA = 0, obtained 
from the characteristic equation (4). Parameters: A = 
0.1, u = 7T, r = 0.38, and e = 0.01. 

the absence of a control force, the system is unstable with 
ReA = ReAo = A > 0. As the feedback gain increases, 
the largest real part becomes smaller and changes sign 
at Kfi = A/2 where the system gains stability in a flip 
bifurcation. Above this change of stability, the largest real 
part collides with a control-induced branch and forms a 
complex conjugate pair. For even larger values of K, the 
system becomes unstable again in a Hopf bifurcation at 
Kho- Both threshold values of K are marked as green 
vertical lines. 

In the following, we will derive an analytical relation 
between the solutions of the characteristic equation and 
the transient times. Starting from an initial distance 7*0, 
the transient time r tr to reach a neighborhood e « ro 
around the fixed point is given for the uncontrolled case 
of Eq. (3) by the following expression 

Note that A corresponds to the real part of the uncon- 
trolled eigenvalue Ao. Time-delayed feedback influences 
the eigenvalues according to the characteristic equation (4) 
such that the transient time in the presence of the control 
scheme becomes 



r tr (ro) - 




where ReA denotes the largest real part of the eigenvalues 
which is depicted by the black solid curve in Fig. 1(a). 

Figure 1(b) displays the transient time in dependence on 
the feedback gain. The solid curve corresponds to the 
transient time calculated from Eq. (7). The green dots 
depict the transient time r tr obtained from numerical 
simulations of the system's equation (2), where r tr is 
measured as the duration to enter a neighborhood of radius 
e = 0.001 starting from an initial distance ro = 0.1. 
One can see that the transient time diverges at the flip 
bifurcation and the Hopf threshold where the largest real 
part becomes zero. This is indicated by the solid green lines 
at Kfi and K^o- There is a broad optimum of transient 
times in a wide range of feedback gain K. Thus the 
efficiency of control is not very sensitive to the choice 
of K, which is not evident from mere inspection of the 
eigenvalues (Fig. 1(a)). 



Figure 2 shows the transient times in the plane parame- 
trized by both control parameters K and r as color 
code. Note that there are islands of stability separated 
by areas for which the control fails to stabilize the fixed 
point. Similar to Fig. 1(b), the value of the transient time 
becomes arbitrarily large at the boundary of control. The 
black solid curves correspond to the boundary of control, 
i.e., vanishing real part of the largest eigenvalue in Eq. (4). 
Optimum control, i.e., minimum transient times, occurs in 
the center of the tongues of stability r = (2n + l)T /2, 
n e N . 

Since the eigenvalues A are given by the Lambert function 
in Eq. (5), the transient time r tr cannot be written in terms 
of elementary functions. Nevertheless, an approximation 
can be given near the values of K where the largest real 
part changes its sign, i.e., at the boundaries of stability. 
Using a linear approximation of the dependence of ReA 
on the feedback gain K at the flip and Hopf bifurcation 
points Kfi and Kho, one finds for the leading eigenvalue 



0.8 



ReA[K] « ReA' [K fl/ho ] (K - K 



fl/ho) (8) 

^ft/hoi = d ^/ dK W=K fl/ho . Writing the eigen- 
value A in terms of the Lambert function W as given by 
Eq. (5) this derivative becomes 



ReA' [if] 



d 

dK 



-1 



-W(k) 



A ± iu ■ 



K 



(9a) 
(9b) 
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1 d 

t dhv vv dK 

with the abbreviation k = Xre~^ x±lu ^ T+KT . Using the 
analytical expression for the derivative of W (Corless et al., 
1996) 

d „ T/ , W(n) 



dK w ^ = .[i 



W(k)] 



(10) 



for k / 0, and using Eq. (5) to express W(n) in terms of 
A, it follows from Eq. (9b) 

[(ImA-^) 2 + A(A-^)]r-A 

K [(ImA - to) 2 + (K- A) 2 ] r 2 + 2K(K — A)t + K 

(11) 

Therefore, for the expression around the flip threshold, 
where K = Kfi = A/2 and ImA = uo holds, one obtains 



ReA [if] : 



At -2 



(K — Kfi) 



(12) 



and for the transient time 

r tr (K) « (K - Kfi ) ~ 1 log (^) . (13) 

In analogy, one finds near the Hopf threshold at if^ , 
where the imaginary part of the largest eigenvalue is given 
by ImA = uo ± y / (2K ho - A)A (Yanchuk et al., 2006), the 
following expression 

ReA [if] « [HrK ho -l)}(K-K ho) 
which yields 

Ttr(K) 



T 2 Kl Q + 2 (Kho ~ A) tKhq + Khp bg p j 



[A(r^ -1)] (if -if, 



ho) 



(15) 

Hence, in both case a power-law scaling of the transient 
time rtr ~ (K — Kfi/ho) 1S obtained. 




Fig. 3. Linear approximation for ReA at K = Kfi and 
K = K^ as dashed red lines. The black curve 
shows the largest real part as in Fig. 1(a). The insets 
(b) and (c) show the transient times at the flip 
and Hopf threshold according to Eqs. (13) and (15), 
respectively. Parameters as in Fig. 1. 

We note that a supertransient scaling (Tel and Lai, 2008) 



of the form r tr (K) ~ exp [C [K — Kfi/ ho 
itive constants C and x cannot be founc 



with pos- 
because the 



derivatives of ReA at K 



K 



lim 



Kfl/ho d° n °t vanish 
ReA ^ 0, 



(16) 



^fi/ho dK 
as can be seen in Fig. 1(a). 

Figure 3 depicts the linear approximations of ReA at the 
flip and Hopf threshold points Kfi and Kho as dashed 
red lines according to Eqs. (12) and (14), respectively. 
The insets (b) and (c) display the transient time around 
these K- values as given by Eqs. (13) and (15), respectively. 
While the linearization yields a good approximation at the 
flip threshold, its deviations are more pronounced at the 
Hopf threshold because ReA changes here at a slower rate. 

3. NONLINEAR TRANSIENTS 

This Section is devoted to investigations in nonlinear 
systems containing periodic orbits. We will consider the 
Hopf normal form as a generic model given by the following 
equation (Stuart-Landau oscillator) 

z(t) = (A + iuj)z(t) + (a + ib)\z(t)\ 2 z(t). (17) 

As an extension to Eq. (2) of Section 2, a cubic nonlinearity 
is taken into account with real coefficients a and b. Before 
addressing the effects of time-delayed feedback on this 
system, we will briefly review the uncontrolled case in 
terms of the transient times. Using again amplitude and 
phase variables, i.e., z = re lip Eq. (17) becomes 

r(t)= [A + ar(t) 2 ] r(t) (18a) 

(p(t)=u + br(t) 2 . (18b) 

Note that the equation for the amplitude (18a) yields a 
periodic orbit with rpo = ^—X/a. In the following, we 
will restrict our consideration to the case a < which 
corresponds to a supercritical Hopf bifurcation, i.e., there 
exists a stable periodic orbit for A > 0. 





0.01 



0.001 



^ — _ 


(e) 






/ 




/ 




/ 









250 t 500 750 250 t 500 750 



1200 
800 
400 




(c) 



600 
400 
200 





(f) 






V 



0.1 r 0.2 0.3 0.1 r 0.2 0.3 



Fig. 4. Time series of the amplitude r (top: linear, middle: 
logarithmic scale) and transient time (bottom) for 
a system with supercritical Hopf bifurcation (a)-(c): 
A = -0.005 and (d)-(f): A = 0.01; dashed green 
and solid curves denote an initial radius smaller and 
greater than the radius of the stable periodic orbit 
Tpo — y^—X/a. (c) and (f) display the transient times 
for e = 0.001. The dotted red curve in panel (c) 
refers to the linear case of Sec. 2. Parameters: uo = 7r, 
a = —0.1, and b = 1.5. 



Similar to Sec. 2, the transient time can be calculated from 
the amplitude equation (18a) as follows 

nM) = / -— ■ ^ (19a) 



r(A + ar 2 ) 



log 



1 

2A 



log 



' PO 



(19b) 



PO 



where ro denotes an initial amplitude and the final ampli- 
tude rf is chosen as e or rpo ± e for the analysis of the 
transient time concerning the fixed point at the origin and 
the periodic orbit, respectively. Note that the coefficients 
in front of the two logarithmic functions correspond to the 
inverse of the real part of the eigenvalue A of the fixed point 
and the Floquet exponent Apo = — 2 A of the supercritical 
periodic orbit, respectively. 

Figure 4 depicts the time series of the amplitude r = \z\ 
and the transient time r tr of the Hopf normal form (17), 
where panels (a)-(c) and (d)-(f) correspond to a parameter 
value below (A = -0.005) and above (A = 0.01) the 
Hopf bifurcation, respectively. Note that the time series 
is displayed in linear as well as logarithmic scale. 

Below the bifurcation, the stable fixed point at the origin 
is the only invariant solution. Panel (b) shows that this 
fixed point is approached exponentially. Panel (c) depicts 
the transient time in dependence on the initial amplitude 
ro according to Eq. (19a). The dashed (red) curve refers to 
the linear case discussed on Sec. 2 showing the difference 
to the nonlinear system Eq. (17). 




Fig. 5. Transient times to reach the fixed point at the 
origin in the (if, ro) plane as color code. The dotted 
line at KTq = 8 corresponds to the feedback gain 
used in Fig. 7. The white areas indicate parameter 
pairs for which the trajectory does not reach the fixed 
point. The circles mark parameters used in Fig. 6. 
Parameters: A = 0.5, e = 0.001, a — —0.1, b = 1.5, 

UJ = 7T, T = 1. 

Above the bifurcation (Fig. 4(d)- (f)), the fixed point 
is unstable and the trajectory approaches the periodic 
orbit Tpo = y— A/a. Note that the dotted (green) and 
solid curves correspond to initial conditions ro inside 
and outside this periodic orbit, respectively. For initial 
conditions close to the origin the transient time becomes 
arbitrarily large as the trajectory needs more time to leave 
the vicinity of the repelling fixed point. 

Next, we consider effects of time-delayed feedback control. 
Applying this control scheme to the Hopf normal form, the 
system's equation (17) becomes 

z(t) = [A + iu + (a + ib)\z(t)\ 2 ] z(t) - K[z(t) - z(t - r)] 

(20) 

with the feedback gain K G M and time delay r. In the 
following, we will keep the time delay fixed at r = 1 = 
T /2, as in Sec. 2, but set initial conditions as x = ro, y = 
for t G [-r,0). 

Figure 5 depicts the transient time r tr in dependence on 
the feedback gain K and initial amplitude ro as color code. 
The delay time r = To/2 was demonstrated to be an 
optimal choice in the purely linear system discussed in 
Sec. 2. The white areas correspond to parameter values 
for which the trajectory does not reach the fixed point. 
For K = the fixed point is unstable. For a certain finite 
non-zero feedback gain, however, the fixed point can be 
stabilized by time-delayed feedback. The transient time r tr 
becomes larger as K increases even further until control is 
lost again similar to Fig. 1(b). 

For a better understanding of the success and failure of 
the time-delayed feedback scheme, Fig. 6 shows the time 
series for selected combinations of the feedback gain K 
and initial amplitude ro- Panels (a),(c),(e), and (g) depict 
the trajectory in the (x, y) phase space where the arrow 
indicates the direction. Panels (b),(d),(f), and (h) display 
the time series of the amplitude r = \z\. The parameters 
K and ro are chosen as follows: Figures 6(a)-(d) illustrate 
the behavior at the left boundary of the yellow region of 
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Fig. 6. Phase portraits (left column) and time series 
r(t) = \z(t)\ (right column) for different combinations 
of ro and K. The red arrows indicate the direction 
of the trajectory. (a),(b) KTq = 4, ro = 2; (c),(d) 
KT = 4,r = 3; (e),(f) KT = 9,r = 5; (g),(h) 
KTq = 10, ro = 5. These values of ro and K are 
marked in Fig. 5 as circles. Other parameters as in 
Fig. 5. 

Fig. 5 with fixed feedback gain KTq = 4. While the fixed 
point is still stabilized in panels (a),(b) for ro = 2, the 
control fails for ro = 3 in panels (c),(d) where a delay- 
induced stable periodic orbit is asymptotically reached. 
On the right boundary of Fig. 5 and for fixed ro = 5, 
panels (e),(f) correspond again to successful stabilization 
of the steady state at the origin for KTq = 9, whereas 
slightly larger feedback gain (KTq = 10) of panels (g),(h) 
results asymptotically in a delay-induced torus (see inset 
in Fig. 6(h)). This explains the modulation of the stability 
range in Fig. 5 due to resonances with delay-induced 
periodic or quasi-periodic orbits which reduce the basin 
of attraction of the fixed point. 

In contrast to the linear case, the controllability displays 
an interesting non-monotic dependence upon the initial 
condition ro, with a strongly reduced range of control at 
certain values of ro resembling resonance-like behavior. 
Although the fixed point is locally stable under time- 
delayed feedback control in the whole range of K shown 
in Fig. 1(a), the global behavior is strongly modified by 
a finite size of the basin of attraction. This is reflected in 
the effect of the initial condition upon the transient time 
as displayed in Fig. 7 for fixed feedback gain KTq = 8, 
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Fig. 7. Transient time r tr in dependence on the initial 
radius ro for a fixed feedback gain KTo = 8. The 
dashed red curve refers to the analytical formula of 
the uncontrolled case given by Eq. (19b). Parameters 
as in Fig. 5. 
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Fig. 8. Same as Fig. 5 for a = 0. 

i.e., along the vertical dotted line indicated in Fig. 5. 
One can see a strong increase of r tr for small ro which is 
followed by a damped oscillatory behavior. For large initial 
amplitudes, this curve approaches the value corresponding 
to the uncontrolled system which is added as dashed red 
curve and calculated from Eq. (19b) for a real part A = 
—0.062 of the eigenvalue of the stabilized fixed point and 
a = —0.003 (fitted parameters). The strong modulation 
of the transient time with ro can be explained by the 
following qualitative argument. It follows from Fig. 2 that 
control works best in the linear system if r = Xb(2n + 
l)/2 where To = 2tt/u; is the intrinsic timescale of the 
uncontrolled system, and it fails for r = nT , n G N. Now, 
in the nonlinear system, the effective angular velocity cj* 
changes with distance ro from the fixed point according to 
u* = u + br% by Eq. (18b). For b > the angular velocity 
increases with increasing initial radius ro- Hence, the 
period T* = 27r/o;* decreases with increasing radius. Thus, 
for fixed r = T /2 and increasing ro, the ratio r/T* = (1 + 
6ro/^)/2 successively passes alternating half-integer and 
integer values. This suggests that the resonance conditions 
for best and worst control are alternatingly satisfied, even 
though the fixed point itself is still linearly stable. By this 
we can explain the modulation of the transient time in 
Fig. 7. This is, of course, a simplified argument, since 
it does not take into account that not only the angular 
velocity is shifted by the nonlinearity, but also the radial 
velocity changes nonlinearly with radius by Eq. (18a). 

In order to clearly separate the effects of modified angular 
and radial velocity, we will now consider the limit case 
a = where the nonlinearity affects only the angular 
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Fig. 9. Same as Fig. 7 for a = 0. 

velocity uo* and hence T*. Figure 8 illustrates the behavior 
of r tr for a = in the {K, ro)-plane. In contrast to Fig. 5, 
the domain of control is no longer connected but consists 
of several islands of stability. They are separated by white 
regions where control fails. The sequence of these white 
regions with increasing ro can be qualitatively explained 
by the condition r = nT*, n G N, i.e., ro ~ \/n — 1/2. 
Here, the transients do not converge to the fixed point 
although this is linearly stable, but rather to a delay- 
induced orbit. This is clear indication of the finite basin of 
attraction of the fixed point, and of complex global effects 
in the nonlinear system. Note that our simple qualitative 
explanation does not describe the exact position of the 
gaps of stabilization, since cu* changes with increasing 
time, and the condition r = nT* holds only for the linear 
system. Within the stability islands, larger feedback gain 
K leads to longer transients. 

Similar to Fig. 7 , Fig. 9 shows a vertical cut of Fig. 8 
for fixed feedback gain KTq = 8 as indicated by the 
dotted line. One can see that the transient times becomes 
arbitrarily large at the boundaries of the stability islands. 
Note that the transient time is bounded from below by the 
dashed red curve which corresponds to the uncontrolled 
case according to Eq. (19b) with A = —0.062 and a — 
-0.0015. 

4. CONCLUSION 

In conclusion, we have shown that the transient times 
for control of steady states by time-delayed feedback are 
strongly influenced by the interplay of local and global 
effects. In a linear delay system the transient time scales 
with an inverse power law of the control gain if the 
boundary of stabilization is approached. In a nonlinear 
system, e.g., a Hopf normal form, global effects due to 
coexisting stable delay-induced orbits lead to strongly 
modulated transient times as a function of the initial 
distance ro from the fixed point. These results are relevant 
for the optimization of time-delayed feedback control. 
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